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ABSTRACT 


An  investigation  of  expected  sample  size  (E[N]), 
variance  of  sample  size  CV[N])  and  robustness  of  four 
sequential  tests  applicable  to  testing  bombing  system 
accuracy  is  made  using  computer  simulation. 

Operating  characteristics,  E[N] , V[N]  and  error  rates 
for  these  tests  are  presented. 


4 


TABLE  OF  CONTENTS 


I.  OBJECTIVE 6 

II.  DESCRIPTION  OF  THE  TESTS 7 

A.  INTRODUCTION  7 

B.  TEST  CASE  A;  SEQUENTIAL  RAYLEIGH  TEST 10 

C.  TEST  CASE  B;  A SEQUENTIAL  BINOMIAL  TEST 

WITH  Po  = 0.5  13 

D.  TEST  CASE  C;  A SEQUENTIAL  BINOMIAL  TEST 


WITH  NULL  PARAMETER  WHICH  MINIMIZES  E[n] 


UNDER  Hq  16 

E.  TEST  CASE  D;  A SEQUENTIAL  BINOMIAL  TEST  WITH 

NULL  PARAMETER  WHICH  MINIMIZES  MAXIMUM  VALUE  OF 
E[n]  20 

III.  DETERMINATION  OF  SIMULATION  FACTORS  23 

IV.  RESULTS  AND  COMMENTS  33 

V.  CONCLUSION 48 

APPENDIX  — 4 9 

LIST  OF  REFERENCES 51 

INITIAL  DISTRIBUTION  LIST  52 


5 


I . OBJECTIVE 


In  this  thesis  the  Sequential  Rayleigh  Test  and  three 
sequential  binomial  tests,  which  are  applicable  to  testing 
bombing  system  accuracy,  are  compared  by  computer  simulation. 

The  objective  of  this  thesis  is  to  investigate  expected 
sample  size,  variance  of  sample  size,  error  rates  of  these 
tests,  and  to  investigate  their  robustness. 
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II » DESCRIPTION  OF  THE  TESTS 

A.  INTRODUCTION 

There  are  two  types  of  tests  of  a system  (which  is 
taken  to  be  a bombing  system  in  what  follows) . The  sample 
size  is  determined  as  a direct  result  of  the  experiment 
in  one  case  (and  is  therefore  random) , and  the  sample  size 
is  selected  prior  to  commencing  the  test  in  the  other  case. 

The  former  procedure  is  called  a sequential  test  [1] . 
The  test  procedures  being  considered  here  are  sequential, 
and  are  based  on  assumed  circular  normal  distribution  (that 
is,  bivariate  normal)  with  the  same  variance  in  each  co- 
ordinate. In  the  coordinate  system  of  the  target  plane  it  is 
assumed  that: 

— Normal  (0,  o^) 

Y. — ’ Normal  ( 0,  a^)  . 

The  origin  of  coordinate  system  is  the  target,  and  x and 
Y are  distances  from  the  weapon  impact  to  the  target  along 
the  X and  Y axes . 

If  it  is  further  assumed  that  X and  Y are  independent, 
then  — ^ is  normal  with  mean  0,  variance  1.  — ^ is  normal 

with  mean  variance  1.  Thus  ( Chi- 

square  distribution  with  two  degrees  of  freedom. 
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The  density  function  of  Chi-square  with  two  degrees  of 


freedom  is  [21 


(t) 


2-r{l) 


. e t>o 


^ e 


This  is  the  exponential  density  function  with  parameter 
2"  « Here/ 


, where  is  squared  miss 


X 2 y2 
o2  " a2  = 

distance  of  the  impact  from  the  target.  Let  this  be  another 
random  variable  Z.  Then, 

Z ^ Exp(w) 
a2 

The  density  function  of  Z is  derived  as  follows: 


F^Cz)  = P [ Z<  z ] 


= P [-^1  ^ 1 . 
a a 
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z 

Let  be  Z ; 

then  F„(z)  = 

Z Z ^ 

Where  Z ' is  exponentially  distributed  with  parameter  x=  ^ • 
Then 

Fz>(-^)  = 1-exp  [-Z/2. 0^]  =^2  (z)  . 

o 

7 

From  the  relation  that  = Z'  the  density  function 

a 

of  Z is  [5] 

— exp  [-z/2  . ] = ^,(2) 

20^  ^ 

which  is  the  exponential  density  function  with 

Assume  C is  the  median  of  Z (C  represents  CEP^ 
fined  to  be  the  median  of  the  squared  Circular 
[6]). 

Then  by  definition: 

F^(C)  = ^ 

1 -exp[-C  /2.a^]=  ^ 

— ■— y = £.n(-y) 

20"^  ^ 

„2  _ C 

^ 2j!,n2 

Thus  Z Exp 


parameter  X=  1 

which  is  de- 
Error  Probable 
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If  a bombing  system  has  been  specified  to  have  median  radial 

miss  distance  Yo  and  if  a system  with  radial  miss  distance 

2 

Yi  is  unacceptable,  this  can  be  tested  with  Co=  Yo  as  the 

2 

null  hypothesized  median  and  Ci  =Yi  as  the  alternative 
hypothesized  median.  Here,  &n2  £ n2  are  the  parameters 

Co  • 

under  null  and  alternative  exponential  distributions, 
respectively. 

In  what  follows  Co  will  be  treated  as  median  under  null 
hypothesis  and  as  median  under  alternative,  where  these 
quantities  relate  to  the  squared  radial  miss  distribution. 


B.  TEST  CASE  A:  SEQUENTIAL  RAYLEIGH  TEST 

If  a system  is  to  be  tested  with  null  hypothesis 
H^:  CEP  ^ alternative  hypothesis  H^^ ; CEP  ^ 

with  type  I and  type  II  error  rate  a and  6,  then  a sequential 
test  for  H^  against  Hj^  can  be  defined  as  follows.  We  shall 
call  this  the  "Sequential  Rayleigh  Test"  in  what  follows; 
it  is  an  application  of  Wald's  Sequential  probability  ratio 
test  to  the  exponential  situation  described  above. 

Two  positive  constants  are  chosen,  B and  A,  where  B < A. 

At  each  stage  (n-th  experiment  or  observation) , the  probability 


ratio 


n 

n 

i=l 


f(Zj^;  Cj^) 


, called  the  likelihood 


f(Zi;  Cq) 


ratio  [3],  is  computed,  where  f(z^;  Cj)  is  the  exponential 

density  function  with  parameter  £ n 2 , j = 1,2 

■=3 
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n €(z^, 

If  B<  .n,  ^ <A,  then  another  observation  is  made  (this 

i-x  riz^,  Cq) 

s t 

means  the  test  enters  tl  • (n+1)  stage). 

If  the  likelihood  ratio  does  not  fall  in  the  interval  (B,A) , 

called  the  continuation  region,  the  test  terminates. 

In  termination,  the  conclusion  is  to: 

n f(z.,  C,) 

Accept  if  rri'.,— C~:r  - 

n f{z.,  C,) 

Reject  if  > a. 

For  a test  with  approximate  level  of  significance  a and  power 
1-6,  one  may  define  [1] 


A = ' and  B = T . 

a 1-a 

Thus,  an  approximate  bound  for  each  stage  can  be  obtained  as 
follows : 

The  explicit  form  of  the  likelihood  ratio  is 


n 

n 

i=l 


f(z.,C  ) 
1 o 


_ (*.n2/C-j^)  .expt-Zj^.An2/Cj^]  . - - - . (£n2/C2^)  . exp  [-z^.  Iln2/C^] 
(£n2/C^)  .expt-z^.iin2/C^]  . - - - . (£n2/C^)  . exp [-z^. Jln2/CQ] 

(An2/C, )".  ( ? z . ) .exp['£n2/C, ] 

= ^ i=l  ^ ^ 

(£n2/C)’^.(  E z.)  .exp[-Jln2/C  ] 

o i^l  1 o 
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This  is  equated  to  A and  the  logarithm  is  taken  to  obtain 


rejection  bound  for  the  n-th  stage; 


The  test  rejects  if 


n 

where  I z.  is  sum  of  squared  radial  miss  distances. 
i=l  ^ 

The  same  procedure  can  be  applied  to  B: 


Here,  it  is  assumed  > C^,  which  is,  we  envision,  true 
in  the  bombing  system  test. 
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C.  CASE  B:  SEQUENTIAL  BINOMIAL  TEST  WITH  = 


In  the  study  of  bombing  system  the  target  is  defined  to 
be  a point  on  the  impact  plane  and  impact  of  a bomb  within 
(over)  some  distance  /r  from  the  target  is  defined  to  be  a 
hit  (miss) . 

2 

A null  hypothesis  that  CEP  = is  to  be  tested  against 

2 

an  alternative  hypothesis  that  CEP  = with  Type  I and 
Type  II  error  rates  a and  where 

2 

Also  this  system  can  be  tested  with  CEP  < as  null 
2 

hypothesis  and  CEP  ^ as  alternative  hypothesis  without  al- 
tering the  test  procedure. 

Let  Pq  be  defined  as  the  probability  of  hit  under  the  null 

hypothesis,  and  Pj^  to  be  the  hit  probability  under  the  alterna- 

2 

tive  hypothesis.  Then  under  CEP  < C^,  which  says  the 

true  median  of  squared  radial  miss  dis  tance  is  less  than  or 
equal  to  Cq,  implies  the  probability  of  hit  is  greater  than 
or  equal  to  0.5. 

2 

similarly,  CEP  > implies  the  probability  of  hit  is 
less  than  or  equal  to  0.5  under  the  alternative  hypothesis.  So 
the  new  hypotheses  are  defined  as  P^>  0.5  and  P^^  < 0.5. 

From  this  hit  or  miss  criterion  r,  a value  of  squared  radial 
miss  distance  may  be  obtained  which  gives  P^  value  of  0.5; 
i.e.,  if 
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-In2  . r 
C_ 


F2(r)  = 1-e 


= 0.5 


then  £n(0.5)  = (£n2) . (- 


-)  , so  r = Cq. 


The  alternate  hit  probability  is  found  as  follows; 

?!  = [hit  I CEP^  = 

2 

= P [observed  squared  radial  miss  distance  < r | CEP  =C, ] 
ln2  ^ ~ ^ 

= 1 - e Cl  ■ 


£n2 


. C, 


= 1 - e 


= 1-2 


Let  the  random  variable  be  defined  as: 


Zi  = 


0 if  miss  (squared  miss  distance  > r) 

1 if  hit  (squared  miss  distance  < r) 
Then  the  likelihood  ratio  becomes 


n 

n 

i=l 


f (z.,P^) 

TTi-TP^T 


^ (Pj^)^  (i-Pj^)*'"^ 

(1/2)^  (1/2)^"^ 


’ ^1 
iT^ 


' . (1-Pl)" 


»n 


Where  Z = 


i=l 
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For  a sequential  probability  ratio  test  for  the  binomial 
situation,  the  experiment  is  continued  as  long  as  this  value 
remains  between  B and  A. 

An  approximate  acceptance  boundary  is  found  by  substituting 
3 for  B [1] . 


Then  £n^|^>  ^ . Zn  n . Jln(2  (1-Pj^) ) 

Substituting  (l-2”^o/*"l)  for  gives 


+ n.£n  2 


l-=o/=l 


Solving  for  ^Z^  z^,  which  is  a convenient  test  statistic; 


n 

^ 2 . 


z'  3 A -n  . ( 1 - Cq/Cj^)  • Zn2 


Hn  (2 


Co/^l 


Cq/Ci 

(The  inequality  changes  because  implies  2 - 1 < 0.) 

Where  ” Zj^  is  the  number  of  bombs  which  hit  the  target,  out 

1-3 

of  the  total  fire,  n.  And  substituting  — — for  A,  an 
approximate  rejection  boundary  is  found  to  be. 


In 


a. 


l-6)-n.  l-':0 \.£n2 


i=l 


jin 


-l) 


= R 


n 


The  test  now  operates  as  follows: 
in  stage  n. 


if 

n 

ill 

Zi  > 

if 

n 

z . < 

i=l 

1 

n 


Continue  to  stage  n+1  otherwise. 


D.  CASE  C:  A SEQUENTIAL  BINOMIAL  TEST  WITH  NULL  PARAMETER 
WHICH  MINIMIZES  E [N]  UNDER  Hq. 

2 

This  case  also  has  null  hypothesis  CEP  <Cg  and  alter- 
2 

native  CEP  . Let  pQ(r)  be  the  probability  of  hitting  a 
target  of  radius  and  let  Pj^(r)  denote  that  probability 

under  H^.  In  mathematical  form: 


PQ{r)  = Pg{Z<r|CEP^  = Cq.) 
Pl(r)  = Pj.(Z<r|CEP^  = Cj^) 


1-e 


f.n2 
■ ^0 


r 


jln2 


r 
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Cq/Ci 


I Thus:  Pj^(r)  = 1 - [1  - T^ir)] 

\ It  is  desired  to  determine  r so  as  to  minimize  expected  samplfi 

size  n,  required  to  test  Hq  vs  with  Type  I,  II  error  rates 
a,B  respectively,  using  the  Binomial  Sequential  Probability 
Ratio  test. 

The  average  sample  size  function  is 


r,  - (1-L(P0  ) .UnA  + L (P).£nB 

E (NJ  - 7=; r—r 


[1],  [4] 


P,J!,n 


+ (1-P).£n 


where  P is  the  true  probability  of  hit  and  L (P) =P^ [accept  Hq|P]. 
If  PQ(r)  is  chosen  to  be  the  underlying  hit  probability,  then 
L(PQ(r) )=l-a. 

By  substituting  L (Pq (r) ) =l~a , 


A 


1-B,  P3_(r)=l-(l-PQ(r)  )-Cq/C,  ,B  = B 
a 1-a 


in  E[N] 

E(N)  •= 


function,  the  expression  above  becomes 


a£n  ( 

fi-e>\  1 

^ a J + (1-a)  £n( 

1 

Po(r)i[S-nj 

a-(l-PQ(r)) 

o/^i\ 

, "o'"'  / 

-I+Cq/c, 

] + (l-PQ(r))Jln[a-PQ(r)) 


If  a value  of  PQ(r)  which  minimizes  E(N)  is  obtained,  r is  also 
obtained  from  PQ(r).  The  numerator  is  a negative  constant  as 
long  as  B<0.5  and  a<0.5  and  the  denominator  is  a negative  variable 
depending  on  r. 
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L i 


Therefore,  in  order  to  minimize  E(N)  it  is  necessary  only  to 
maximize  the  absolute  value  of  the  denominator. 


Let 


Then  for  various  values  of  K,  PQ(r)  may  be  found. 

Figure  IHshows  a plot  of  PQ(r)  vs  k resulting  from  this 
minimization.  As  k approaches  infinity  PQ(r)  approaches  1.0;  as 
k decreases  to  zero  PQ(r)  decreases  to  around  0.63.  Specifically, 
for  k = 2 

PQ(r)  = 0.8416,  P2^(r)  = 0.6020. 

From  this  r is  found  to  be 


- = 2-65836,0^ 

Let  Z be  a random  variable  such  that 
„ (0  if  squared  miss  distance 

i 1 

/i  if  squared  miss  distance 


> r 
< r 


where  r = 2.65836. 

Then  the  hypotheses  in  this  Binomial  test  becomes: 


^o-  ^o  0.8416,  Hjl:  = 0.602. 

If  p^  = 0.8416,  Pj^  = 0.602  are  substituted  in  the  likelihood 
ratio  (similar  to  Case  B above) , acceptance  and  rejection  bounds 


at  stage  n are; 
Accept  Hq  if 

n 


ill  > -1.2564 


Jin  + n. 0.7333  = A„ 

l-a  n 
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Reject  if 

I < - 1.2564. in  ( + n. 0.7333  = 

i=l 

Continue  otherwise. 


E.  CASE  D:  A Sequential  Binomial  test  with  null  parameter 

which  minimizes  maximum  value  of  E(N) 

In  the  binomial  situation  described  above,  the  hypotheses 

about  the  parauneter  are 

P = P 
o o 

Hi:  P = Pj^. 

The  maximum  average  value  of  E(N)  occurs  very  nearly  at 
I 


P-  = 


\ T--p^TFr 


I n 


>l(r)\ 


SUi 


l-P^Cr) 


[4] 


from  which 
E(N)  = 


JinA.  il  n B 


^l-Pl(r) 


.1-^0 


JhA.  «nB 


£n 

^-(l-PQ(r)  f 

1 

. An 

(l-P^Cr)  fo/Cl  1 

J 

1-P„(r)  J 

(Pj^(r)  = 1 - [l-P^(r)  f O^^l,  See  Case  B) 

The  numerator  is  a negative  constant  for  given  a and  g. 


20 


Similarly  as  in  Case  C by  maximizing  the  absolute  value 
of  the  denominator,  the  maximum  value  of  E[N]  is  minimized  (or 


at  least  nearly  so) . 

Cl 

Figure II- ^hows  the  relation  between  P (r)  and  k = ^ 

o 

Specifically  for  k = 2 

P„(r)  = 0.89867,  P,  (r)  = 0.68167  with  r = - S,  n(i-o. 89867) 

° ^ W2 

3.30286  is  obtained. 

Hence  the  hypotheses  for  this  case  are  : P=0. 89867, 
P=0. 68167,  and  "hit"  is  defined  by  squared  radial  miss 
distance  less  than  or  equal  to  3.30286. 

Let  Z be  a random  variable  such  that 


Zi  = 


0 if  squared  miss  distance  > 3.30286 

1 if  squared  miss  distance  < 3.30286. 


Proceeding  similarly  as  in  Case  B,  the  decision  at  stage  n is 

Reject  H if 
o 


E Z.  < -1.42167  . iln(l-6)  + n.  0.80552  = R 


Accept  if 


I Z.  > -1.42167  . an  ( 8 ) + n.  0.80552  = A„ 

Continue  to  state  n+1  otherwise. 


III.  DETERMINATION  OF  SIMULATION  FACTORS 


For  convenience  the  hypotheses 
Hq.*  CEP^  = 1 

CEP^  = 2 were  selected. 

This  means  k = 2 in  Case  C and  D. 

Type  I and  Type  II  error  rates  were  selected  to  be  0.05. 

But  actual  simulation  gives  Type  I error  rates  .0258,  .0468, 

.0396,  .0292  and  Type  II  error  rates  .0396,  .0402,  .0420, 

.0400  for  Case  A,  B,  C,  and  D,  respectively.  This  point  is  ex- 
plained in  Chapter  3.3  of  [1].  Approximate  error  rates  of 
0.05,  0.05  (Type  I,  II)  were  obtained  by  adjusting  the  bounds 


1*  6 

A and  B,  which  is  possible  by  changing  a,  B in  A = , B = 


6 

L-  a 


The  adjustment  factors  used  here  are: 

CASE  Aa=2.0x0.05  B =1. 2x0. 05 

CASE  Ba=1.2x0.05  B =1. 2x0. 05 

CASE  C a=  1.5  x 0.05  B = 1-15  x 0.05 

CASE  D a=  1.5  x 0.05  B = 1-1  x 0.05 

How  many  replications  are  enough?  Assuming  N^ , N2  have  Bi- 
nomial distribution  with  probability  of  success  0.05,  a sample 
size  n is  found  such  that  P^  ( = 1- a , where  a is  the 


significance  level,  P^,  i=l,  2 is  the  estimation  of  P^  . The  above 
equation  implies 


0 

A 

/V 

^1  - 

P2  < c)  = 1- a 

P-(“C  < 

^ - 

^2  < c)  = 1- a 

n 

n 

P (-nc< 

N 

- N <nc)  = 1-  a 

r 

1 

2 

23 


1 


By  the  Normal  approximation  , (N^  - N2)'~  Normal  with  mean  o and 

Variance  2npCl-p)» 


Thus 


nc 


Y 2np(l-p) 


Nj  - ^2 

v'2np(l-p) 


nc 


V 2np (1-p) 


] = 1-a 


gives 


nc 

sf 2np(l-p) 


a 

7- 


The  following  table  shows  n for  various  values  of  a and  c. 


0.2 

0.1 

0.05 

0.025 

0.02 

= Y 

1.285 

1.645 

1.96 

2.24 

2.33 

0.2 

3.9 

6.4 

9.1 

11.9 

12.8 

0.1 

15.7 

25.7 

36.1 

47.6 

51.5 

0.05 

62.7 

102.8 

145.9 

190.7 

206.3 

0.025 

250.9 

411.3 

583.9 

762.7 

825.2 

0.01 

1568.7 

2570.7 

3649.5 

4766.7 

5157.5 

0.001 

156866.4 

257072.3 

361237.5 

476672.0 

515745  .5 

24 


Assuming  c = 0.01  and  a=  0.02,  an  approximate  value  of 
5000  is  obtained  through  the  table.  By  this  number  of  re- 
plications, obtaining  a difference  in  estimated  error  rates 
greater  than  0.01  is  significant  at  level  0.02.  Exponential 
random  samples  were  generated  by  the  Monte  Carlo  method.  For 
an  exponential  variate  T to  have  median  m,  it  is  necessary 
to  use  the  scale  parameter  X = £ n 2 

n O ^ 

ln2  ^ 

so  F.p(t)  = 1-e  ' 

But  U = F.j,(T)  is  uniformly  distributed  on  (0,1)  [8]. 

-T 

Thus  2 nr“  = 1 - F(T)=1-U  is  also  uniformly  distributed. 

Finally  t . £n2  = -£n  U,  or 
m 

T = - m.  £ n U 

Tn'r 

By  changing  the  median  of  the  population  sampled,  the 
operating  characteristic  function,  expected  sample  size  at 
termination,  and  its  variance  can  be  estimated  for  each  test, 
and  those  can  be  compared. 

The  medians  to  be  generated  are  those  which  result  in  a 
0.1  difference  of  operating  characteristic  function  values 
in  Case  C,  which  is  based  on  minimizing  the  maximum  E(N), 
those  which  yield  Type  I,  II  error  rates,  three  points  which 
yield  approximate  maximum  E(N)  value  (for  Cases  B,  C,  D) , and 
five  more  points  in  both  tails. 


'>• 


JL L 
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By  changing  the  skewness  of  the  sample  distribution, 
comparison  of  the  robustness  of  the  four  tests  of  hypotheses 
about  the  medians  under  null  and  alternative  hypothesis  was 


performed. 

This  is  based  on  the  assumption  that  the  underlying 
distribution  is  WEIBULL  with  shape  parameter  a and  scale 
parameter  X . 

If  T ^ WEIBULL{a,  X } , 


the  distribution  function  of  T is 


Fy{T)  = 1 - e 


- (XT ) « 


Let  m be  the  median.  Then 
Pj.  [T  > m]  = Pj,[T  < m]  ; 

1 . e-<*  0.5, 

lln{0.5)  - - (X.m)“  . 

Solving  for  X, 

X = 

Now  1-e  — ■ u(o,l),  so 

i,n(l-U)  = - (XT)®  , 

1 

T = ^ [£n(U)  ]“  , where  U U (o,l). 

Substituting  X = i (5:n2)^/® 

m 

T = m . -Jinn.''?-WEIBULL{a  (Jm2 
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Following  histograms  in  Figure  III-l  show  the  effect  of 
changing  a in  WEIBULL.  As  a decreases  the  distribution  is 
widely  spread  and  it  is  said  that  the  distribution  has  heavy 
tail  (Figure  III-l,  B).  in  the  opposite  case;  i.e.  a increases, 
it  has  light  tail  (Figure  III-l,  A) . 

Figure  III-2  is  observed  keeping  a fixed  at  1 and  median  is 
0.5,  1.0,  2.0  in  WEIBULL. 

This  is  exponential  distribution  with  median  0.5,  1.0,  2.0. 
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IV.  RESULTS  AND  COMMENTS 


Simulation  of  the  four  tests  were  performed  5,000  times 

2 

(5,000  replications).  In  each  replication  CEP  =1; 

2 

CEP  =2;  and  Type  I,  II  error  rates  are  0.05. 

The  following  tables  rV-1,2,3  show  the  mean  number  of 
terminations,  their  variances,  and  number  of  acceptances  of 
Hq  in  5,000  replications. 

Table  rV-lshows  the  effects  of  changing  median  values,  where 
the  shape  parameter  of  the  WEIBULL  variate  was  fixed  at  1.0 
(the  exponential  variate  with  changing  median) . Table  rV-2  and  3 
shows  the  effects  of  changing  shape  parameter,  the  median  being 
fixed  at  1.0  in  table Il'^-2and  at  2.0  in  table  IV-3. 

For  ease  of  comparison  these  were  graphed.  Each  figure 
contains  four  curves  and  each  curve  represents  the  case  A,  B, 

C or  D. 

In  testing  the  difference  of  E[N],  null  hypothesis  would  be 

E[Nj^]  = E[N2]/  where  Nj^,  N2  are  random  variables  representing 

the  number  of  termination  by  test  cases  which  one  wishes  to 

test  the  difference  of  the  E[N]. 

By  the  central  limit  theorem  [2]  the  difference  in  E[N] 

greater  than  1.96  xd  is  significant  at  level  0.05.  d is 

n 

estimated  standard  deviation  of  N.  But  it  is  different 
between  the  test  cases  being  considered. 

The  larger  one  might  be  selected  so  that  we  may  not 
reject  erroneously. 


^ 
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this  case  is  cbsepveo  changing  shape  parameter  anc  median  is  fixed  at 


THii  Cfl'c  IS  CaSEPVED  CHANGING  SHAPE  PARAMETER  ANC  MEDIAN  IS  FIXED  AT 


REFERENCE  FOR  THE  FIGURES  IV-1  - IV- 9 

_ CASE  A 

+ CASE  B 

* CASE  C 

X CASE  D 

FIGURE  IV-1,  4,  7;  Expected  Sample  Sizes 

FIGURE  IV-2,  5,  8;  Variances  of  the  Sample  Sizes 

FIGURE  IV-3r  6,  9;  Operating  Characteristic  Curves 


rj 


The  interpretation  of  the  figures  is  as  follows: 

a.  Variances  or  standard  deviations  are  approximately  pro- 
portional to  expected  sample  sizes. 

b.  Test  Case  A contains  the  minimum  expected  sample  size  and 
Test  Case  B includes  the  maximum  expected  sample  size  in 
almost  all  instances. 

c.  Case  C and  Case  D yield  similar  results  when  median  is 
changing  and  shape  parameter  is  fixed  at  1.0. 

d.  Test  Case  B is  invariant  about  the  change  of  skewness 
when  the  underlying  median  is  1.0  (See  Figures  IV-4,5,6). 

e.  Case  B also  gives  the  lowest  error  rates  if  the  bomb  im- 
pact has  a heavy  tail  distribution  under  the  alternative 
hypothesized  median,  and  has  light  tail  distribution  under 
null  hypothesized  median  (Figure  IV-6.9). 

f.  Case  C gives  the  lowest  error  rate  when  the  true  median  is 
2.0  and  bomb  impacts  are  clustered  around  the  median. 

NOTES : 

a.  The  adjusting  factors  of  the  error  rates  table  were  devel- 
oped iteratively  and  there  is  no  guarantee  that  these  ad- 
justing factors  are  the  best  ones. 

b.  There  could  be  further  investigation  of  effects  under  er- 
ror rates  other  than  0.05,  or  of  changing  null  and  alterna- 
tive hypothesized  median  values. 

c.  The  Fortran  program  for  this  simulation  is  attached  as  an 
Appendix . 
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V.  CONCLUSION 


If  it  is  certain  that  the  bomb  impact  is  Rayleigh  distributed, 
then  Sequential  Rayleigh  Test  is  appropriate  to  test  the  system. 

In  case  one  has  doubt  about  the  bomb  impact  distribution, 
the  Sequential  Binomial  Test  gives  better  tests  than  the  Se- 
quential Rayleigh  Test. 

Further,  if  there  is  some  reason  to  believe  that  the 
median  is  likely  to  be  1 (so  the  test  is  likely  to  accept  H^) , 

Case  B (Null  pareimeter  P^=0.5)  is  better  than  any  of  the  other 
three  tests. 

If  the  median  is  not  likely  to  be  1,  test  case  A (Sequential 
Rayleigh  Test)  or  test  case  C (which  has  null  parameter  that 
minimized  E[N]  under  H^)  are  the  best  tests. 
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APPENDIX 


DIMENSION  BCUND(300,2,4),DATA(4,4) ,T EST ( 5000 , 2 , A ) 

BOUND CONTAINS  DECISION  BOUNDARIES  FOR  EACH  STAGES 

TEST FIRST  ELEMENT  REPRESENTS  NUMBER  OF  REPLICATION 

SECOND  ELEMENT  REPRESENTS  DECISION 

THIRD  ELEMENT  REPRESENTS  TEST  CASE{A,B,C  OR  D» 

DATA TEST  RESULT, FIRST  ROW MEAN  NUMBER  OF  TERMINA 

TION  SECOND  ROW VARI ANCE, THIRD  ROW NUMBER  ACCEP 

TANCE  FOURTH  ROW NUMBER  REJECTION 

ISEED=  688777 
NC0UNT=50C0 

READ(5,2) ALPHA, BETA, CO, Cl 

CO MEDIAN  UNDER  THE  NULL  HYPOTHESIS 

Cl MEDIAN  UNDER  THE  ALTERNATIVE  HYPOTHESIS 

WRITE! 6, 140) ALPHA, BETA, CO, Cl 

140  FORMAT(5X,  'ALPHA** ,F6.3,*  BE TA=  • , F6. 3 , ' C0  = ',F6.3 
C1=',F6.3) 

R=-C0*ALaG(.1584»/( ALOG(2. ) ) 

R HIT  MISS  CRITERION  IN  CASE  C 

R2 HIT  MISS  CRITERION  IN  CASE  C 

P40=. 898657 

R2=( AL0G(1-P4D) )/ALOG(.5) 

P4l  = l.-l./2#=«'(R2/2.  ) 

2 F0RMAT(4F6.3) 

CCMPUTE  BOUND  OF  REJECTION  AND  ACCEPTANCE 
Bl=ALaG(  L.2#BETA/(1-2.=«'ALPHA)  ) 

Al=ALOG( ( 1-1.2^BETA)/(2.«ALPHA) ) 
B2=AL0G(1.2’*BETA/(1-1.2=«'ALPHA)  ) 

A2*AL0G< (l.-1.2*eETA )/ ( 1 .2 *ALPHA ) ) 
e3=AL3G(l. 15*BETA/( 1-1.5*ALPHA)  ) 

A3  = AL0G(  (l-1.15»6eTA)/{1.5*ALPHA)  ) 

34=AL0G(1. 1*BETA/(1-1.5^ALPHA)  ) 

A4=AL0  6((  l-l.l*BETA)/(1.5*ALPHA)  ) 

AL=(ALOG(2.)  )=’'(  1 ./CO-l./Cl  ) 

AL1=AL0G<2*#(C0/Cl)-1. ) 

F1=1-SQRT( .1584) 

AL2  = ALCG( .1584*P1/(.8416#< 1-Pl ) ) I 
AL3=( ALOGl 2.) ) * ( 1-(C 0/Cl ) ) 

AL4=ALaG((l-Pl)/.1584) 

AL5=ALOG( ( 1-P41 ) /(1-P40) ) 

AL6=AL3G(P41*( 1-P4J) /{P4 J#! 1-P41) ) ) 

00  5 1=1,300 

BQUNOd  , l,ll  = ( I#AL0G(C1/C0)  + 6U/AL 
BOUND!  1,2,1)  = (A1-I*AL0G(CJ/C1)  )/AL 
80UN0!I,1,2I=!A2-I=»AL3)/AL1  * 

BOUND! 1,2, 2)=!B2-I*AL3) /ALl  • 

BOUND! I ,1 ,3)=! A3-I*AL4)/AL2 
BOUND! 1,2,3)=! B3-I 4AL4) /A L2 
BOUND!  1,1  ,4)  = ! A4-I*AL5) /AL6 
BOUND! I ,2,4)=! B4-I *AL5) /AL6 

5 CONTINUE 

300  REA0I5  ,6  ,END=1)00)  FMED, SHAPE 

FMED MEDIAN  VALUE  TO  BE  GENERATED 

SHAPE SHAPE  PARAMETER  IN  WEIBULL  DISTRIBUTION 

6 F0RMATI2F6.3) 

WRITE! 6, 102) FMED, SHAPE 
KCUNT=1. 

DC  7 1=1,4 
00  7 J=l,4 

7 0ATA!I,J)=0. 

Tl(2,3,4) TEST  STATISTIC  FOR  TEST  CASE  A!B,C,0) 

DC£N1!2,3,4)  — TAKES  VALUE  1.  IF  TEST  TERM  INATEO , OTHE 
RWISE  0. 

10  T1=0. 

T2=0. 

T3=0. 

T4=0. 

N=0. 

DCZN1=0 
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0CZN2=0 

DCZN3=3. 

DCZN4=0 

20  CALL  GGUB(ISEEDtlfU) 

X=FMED*(AL0G(U)  /AL0G(  .5n**(  1 ./SHAPE) 

N=N+1 

IF(0CZNl.Eg.l.)GQ  TG  40 
T1=T1+X 

IF{T1.GT.BGLND(N,1,1) .AN0.Tl.LT.BCUND(N,2»l))  GG  TO  40 

TESKKGUNT,  1,1  ) = N 

DATA(l,l)=DATA(ltl)+N 

IF(T1,LE.80UND(N, 1,1) )G0  TO  30 

TEST(K0UNT,2,1)=-1. 

GG  TO  31 

30  TEST(KOUNT, 2,1)=1. 

31  DCZN1=1. 

40  IF{0CZN2.EQ.l. )G0  TO  60 
IF(X.LE.CO) T2*T2+1. 

IF(T2.GT.B0UND(N, 1,2) .AN0.T2.lt. BGUND<N, 2, 2>)G0  TO  60 

TESTCKOUNT,  1,2)=N 

CATA(2, 1 )=DATA(2, 1 ) + N 

IF(T2.GE.B0UN0(N,2,2) )G0  TO  50 

TEST(K0UNT,2,2)=-1. 

GG  TO  51 

50  TEST(K0UNT,2,2)=1. 

51  CCZN2=1. 

60  IF(DCZN3.EQ.1.)G0  TO  80 
IF(X.LE.(1)T3=T3+1. 

IF(T3.GT.B0UND(N, 1,3)  .AND.T3.lt. BOUNDCN, 2, 3))G0  TO  80 

TEST(KOUNT,  1,3)  = N 

DATA(3, 1)=DATA( 3, 1)+N 

I F(T3 .GE.SOUNOIN, 2,3) )G0  TO  70 

THST(K0UNT,2,3)=-1. 

GO  TO  71 


70  TEST(K0UNT,2,3)=1 . 

71  DCZN3=1. 

80  IF(DCZN4.EQ  .1)  GO  TO  90 
IF(X.LE.R2)  T4=T4+1. 

IF(T4.GT.B0UN0(N, 1,4) .AN0.T4.lt. BCUNOCN, 2,4) ) GO  TO  20 

TEST(KOUNT, 1,4)=N 

0ATA(4, 1/=0ATA<4, 1)+N 

IF(T4.GE.B0UND{N, 2,4) ) GO  TO  78 

TEST1K0UNT,2,4)=-1. 

GO  TO  79 

78  TEST(K0UNT,2,4)=1. 

79  DCZN4=1. 

90  D0D=0CZN1*DCZN2*0CZN3 
IF(OOD.NE.l .)G0  TO  20 
KCUNT=KQUNT+1 

IF(K0UNT.LE.NC0UNT)G0  to  10 
DC  100  1*1,4 

100  DATA(I,1)=0ATA(I,1)/NC0UNT 
CO  110  I=1,NC0UNT 

DC  no  11*1,4 

OATA( II ,2)*(TEST( 1 , 1 , 1 1 ) -D ATA ( I I , 1 ) ) #*2 . /FLC AT ( NC CUNT- 
*1  )+DATA( II ,2) 

IF(T£ST(I,2,II).EC.l.)  DATA ( 1 1 , 3 ) =DATA( II,3)+1. 

110  CONTINUE 

DC  120  J=l,4 

120  DATA! J,4)*NC0UNT-0ATA(J,3) 

WRITE(6,130)  ((DATA!  I , J ) , J = 1 , 4 ) , I =1 ,3 ) 

130  FORMAT!/, 4X,'  MEAN* , FIO .5 , • VAR',F10.5,'  NO  ACCEPT  • 

♦,F5.0,*  NO  REJECT  •,F5.0) 

101  FORMAT!! JF10.5  ) 

102  FORMATCSX,'  MEDIAN  IS*,F7.3,'  SHAPE  PARAMETER  IS», 
*F7.3) 

GO  TO  300 
1000  STOP 
END 
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